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DECENTRALIZED  CONTROL  FOR  LARGE  SCALE  HEREDITARY  SYSTEMS 

J.  A.  Reneke  and  R.E.  Fennell 

1.  Introduction.  We  present  the  mathematical  theory  of  a  decentralized 
control  strategy  which  allows  some  level  of  autonomous  component  control 
for  large  scale  systems.  To  indicate  the  difficulties  of  decentralized 
control,  consider  the  problem  of  two  controllers  independently  choosing 
controls  to  steer  the  two  component  system 

h'i  (t)  =  a-]  i h-|  (t-1 )  *  a12h2(t)  *  3-]V2(t) 
h’2(t)  =  a22h2(t)  ♦  e2v2(t) 

from  a  given  initial  position  to  a  desired  terminal  position.  Although  the 
second  component  objective  can  be  achieved  independent  of  the  first,  some 
information  about  the  second  component  is  necessary  for  the  simultaneous 
achievement  of  the  first  objective.  The  basic  problem  considered  in  this 
paper,  a  coordination  problem,  is  how  to  add  conditions  to  the  component 
objectives  and  arrange  exchanges  of  information  which  will  enable  all  of  the 
components  to  achieve  their  objectives  autonomously.  Our  approach  to  to 
the  solution  of  this  problem  requires  that  component  interactions  be 
suitably  limited  so  that  variational  methods  can  be  used  to  determine 
component  control  laws. 

Current  interest  in  coordination  of  large  scale  systems  is  concentrated 
on  the  problem  of  system  optimization  for  hierarchical  or  multilevel  systems 
[4],  [14],  [15].  Methods  employed  are  typically  off  line  iterative  and  are 
usually  only  applied  to  finite  dimensional  state  space  systems.  Our 
methods  apply  to  systems  modelled  by  delay  differential  equations  and 
integral  equations.  Also  application  of  these  methods  to  control 
coordination  problems  for  large  scale  systems  leads  to  closed  loop  controls. 


In  our  approach  coordination  of  local  control  laws  is  achieved  in  one  step 
by  the  imposition  of  additional  constraints  on  the  system  components. 

Large  scale  systems  will  be  described  by  operator  equations  defined 
on  an  infinite  dimensional,  reproducing  kernel  Hilbert  space  and  variational 
methods  will  be  used  to  solve  terminal  constraint  problems.  A  similar 
approach  to  the  solution  of  optimal  control  problems  for  systems  modelled 
by  functional  differential  equations  or  Volterra  integral  equations  appears 
in  the  work  of  Neustadt  [10].  In  Section  II  we  present  the  Hilbert  space 
background  necessary  for  our  analysis.  Reproducing  kernel  Hilbert  spaces 
are  frequently  used  for  the  analysis  of  system  problems,  see  the  texts 
[3],  [16]  and  the  references  there.  We  have  previously  used  a 

reproducing  kernel  Hilbert  space  of  Hellinger  integrable  functions  to 
analyze  identification  and  estimation  problems  [2],  [12].  Such  spaces  have 
also  arisen  in  the  analysis  of  stochastic  systems  [9]. 

We  are  interested  in  terminal  constraint  and  trajectory  following 
problems.  In  Section  III  Lagrange  Multiplier  methods  are  used  to 
characterize  the  solution  of  component  control  problems  with  interval 
constraints.  Two  local  optimization  problems  are  considered.  One  problem 
applies  to  hereditary  systems  in  general  while  the  other  applies  only  to 
finite  dimensional  state  space  systems.  In  the  first  problem  a  novel 
performance  index  is  used  while  a  more  standard  quadratic  cost  functional 
appears  in  the  second  problem. 

The  ability  to  coordinate  locally  designed  control  laws  depends  on  the 
type  of  interaction  between  system  components.  The  concept  of  stably 
connected  systems  is  introduced  in  Section  IV  to  describe  interaction 
between  system  components.  Coordination  strategies  can  be  developed  for 
stably  connected  systems  by  addirg  side  conditions  to  the  component 
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requirements  and  using  the  results  of  the  local  optimization  problems 
developed  in  Section  III.  Finite  dimensional  state  space  systems  whose 
system  matrix  is  block  triangular  or  decomposed  by  strong  components  [8] 
are  stably  connected.  In  Section  III  we  indicate  how  coordination 
strategies  can  be  developed  for  two  component  and  other  multicomponent 
systems. 

2.  Preliminaries.  For  0<r<T  let  S  denote  the  interval  [-r,Tj,  X  = 
denote  the  space  of  real  d-tuples  with  the  usual  inner  product  <*,•>  and 
norm  |*|.  Let  G  denote  the  space  of  functions  from  S  to  X  which  are 
continuous  on  S  except,  possibly,  for  a  jump  discontinuity  at  t  =  0 
(assume  right  continuity  at  0),  and  let  associated  semi-norms  be  defined 
by  Nx(f)  =  suP-j-<t<xl^^  I  *or  x  in  s  and  f  in  G-  Let  k  be  a 
nondecreasing,  right  continuous  function  on  S  with  k(-r)  =  1  and  a  jump 
discontinuity  at  t  =  0.  We  define  B  to  be  the  set  of  linear  transformations 
of  G  to  which  B  belongs  provided  1)  [Bf](t)  =  0  for  -r<t<0  and  2)  there  is 
a  constant  b  such  that  for  any  u,  v  in  S  with  u<v,  |  [Bf]  (v)-[Bf](u)  |  < 
b/^Nx(f)dk(x) .  Operators  in  B  are  bounded  transformations  from 
{G,N.j.}  to  {G,N-j-}.  Systems  whose  dynamics  can  be  described  by  an 
operator  equation  of  the  form  h  =  f  +  Bh  with  B  in  B  are  referred  to  as 
hereditary  systems.  The  defining  properties  of  the  class  B  not  only 
guarantee  the  existence  and  uniqueness  of  solutions  to  the  systems  under 
consideration  but  also  imply  the  invertibility  of  the  system  input-output 
operator. 

THEOREM  2.1  [12]  If  B  is  in  B  then  l-B  maps  {G,N-j-}  onto  {G,Ny}  and 
l-B  has  a  bounded  inverse. 


Thus  for  B  in  B  and  A  =  (l-B)  we  have  the  equivalent  system 

realizations 

h  =  f  *  Bh  *  gu  and  h  =  A(f  +  gu)  (2.1) 

where  f,  u  in  G  denote  system  inputs  and  controls  and  g  denotes  a  linear 
transformation  from  X  to  X.  One  should  note  that  [Af]  (t)  =  f ( t )  for  each 
f  in  G  and  -r<t<0. 

Example  2.1.  As  an  example  consider  a  system  of  delay  differential 

equations  of  the  form 

h’(t)  =  a^h(t)  *  a2h(t-r)  *  g^v^ft)  ♦  B-^Ct)  *  e(t) 
for  OitiT  and  initial  condition  h(t)  =  0(t)  for  -rit<0.  Here  g^,  g2 

represent  matrices  of  appropriate  dimension  and  r  denotes  a  delay 
parameter.  Taking  [Bh](t)  -  0  for  -r!t<0  and  [Bh](t)  = 

/Q[a^h(t)*a2h(t-r)]dt  for  0<t^T,  the  system  may  be  written  as 

h  =  f  *  Bh  *  g.jU.j  *  g2u2  (2.2) 

with  f(t)  =  $(t)  for  -r<t<0,  f(t)  =  0(0)  ♦  /Qe(-c)dt  for  0<t<T  and  Uj(t)  =  0 
for  -r<t<0,  Uj(t)  =  /QVj(t)dT  for  0<t<T  ,  i  =  1,2.  With  k(t)  =  l+r+t  for 
-r<t<0  and  k(t)  =  2*r*t  for  0<t<T,  it  follows  that  B  is  in  B.  The  jump 
discontinuity  in  k  at  t  =  0  allows  a  similar  discontinuity  in  the  solutions  of 
(2.2). 

Analysis  of  the  optimal  control  problems  to  be  considered  is  simplified 
when  the  domain  of  operators  in  B  is  restricted  to  the  reproducing  kernel 
Hilbert  space  G j_j  of  Hellinger  integrable  functions.  Defining  properties  of 
this  space  may  be  found  in  the  papers  [2],  [6],  [12].  For  completeness 
we  mention  those  properties  which  will  be  used  in  this  paper.  The  space 
Gj_j  is  the  subspace  of  G  with  inner  product  denoted  by  Q^C*,*), 


associated  norm  N^(»),  and  reproducing  kernel  K  defined  by  K(s,t)x  = 
k(s)x  for  - r<s<t<T ,  =  k(t)x  for  -r<t<s2T  with  x  in  X.  H  ere  we  restrict  k 
as  defined  in  Example  2.1.  The  kernel  K  maps  SxS  into  the  linear 


transformations  of  X  and  satisfies  K(»,t)x  is  in  and  <f(t),x>  = 

QH(f,K(  ,t)x)  for  each  t  in  S  and  x  in  X.  It  may  be  shown  shown  that 
Q|_j(f,g)  =  <f(-f*),g(-r)>  ♦  /]"r<df,dg>/dk  where  / Jr<df , dg>/dk  is  the 
limit  through  refinement  of  the  approximating  sums 


2<f(Sj)-fCs._^),gCsi)-g(s.|_^)>/CkCs.)-kCs.i_1))  with  (s.^  i  =  Q,...,n>  a 


partition  of  S.  The  following  result  motivates  us  to  restrict  attention  to 


systems  described  by  operator  equations  on  {G|_|,Q^}. 


COROLLARY  2.2  [12]  If  B  is  in  B  then  l-B  maps  onto 

{Gj_|,Nj_|}  and  A  =  (l-B)  ^  is  a  bounded  transformation  from  onto 


For  future  reference  we  define  on  G^  the  family  of  projection 
operators  (P^:  t  in  S}  by  [P^fJCs)  =  f(s)  for  -r<s^fcsT  and  [ P^f ]  C s )  =  f(t) 
for  -r<t£s<T.  It  may  be  shown  that  operators  B  in  8  and  A  =  (l-B)  ^ 
satisfy  the  causal  property  P^B  =  P^BP^,  P^A  =  P^AP^  for  all  t  in  S.  It  is 
also  useful  to  note  that  B.JU-B2)  ^ ,  (l  ~  ®  2^  ^®i'  an<-'  are  m  ® 

whenever  B^,  B2  are  in  8.  We  will  make  frequent  use  of  the  operator  C 
in  8  defined  by  [Ch](t)  =  0  for  -r<t<0  and  [Ch](t)  =  /gh(T)dk(t)  for 
0<t^T.  The  adjoint  of  C  is  given  by  [C*h](t)  =  K(t,T)h(T)  -  K(t,Q)h(0) 
-  [Ch](t)  since 

QH(f,C*h)  =  QH(Cf.h)  =  :J<f,dh> 

=  <f(T),h(T)>  -  <f(0),h(0)>  -  <df ,  h> 

=  <f(T),h(T)>  -  <f(0),h(0)>  -  ;J<df,dCh>/dk 
=  QH(f,K(  ,T)h(T)-K(  ,0)h(0)-Ch) 
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for  all  f,  h  in  G^.  Finally,  for  sufficiently  smooth  functions  note  that 
NH2(f)  =  |  f  CO)  |  *  /q  |f’(t)  |2dt  and,  hence,  N^^CCh)  =  7gh2(T)dT. 

We  conclude  this  section  by  stating  a  controllability  assumption  for 
hereditary  systems.  Let  &  be  a  linear  transformation  from  X  to  X  and  let 
Gy  denote  the  set  of  u  in  G j_j  with  the  property  that  P^u  =  0  and  u(t) 
belongs  to  the  orthogonal  complement  of  the  null  space  of  3  for  -r<t<7. 
Note  that  Gy  is  a  closed  subspace  of  G^  .  We  restrict  attention  to 
controls  u  in  Gy. 

Controllability  Assumption:  For  B  in  B,  and  3  3  linear  transformation  from 
X  to  X  assume  A3  =  ( I  -  B )  3  maps  Gy  onto  ( I  - PQ) G  H . 

Note  that  for  3  =  1  the  invertibility  of  the  input  output  operator  A 

guarantees  controllability.  For  delay  differential  equations,  (2.1),  this 
assumption  implies  function  space  controllability,  [1],  [7],  [13]. 

3.  Local  Optimization  Problems.  The  control  coordination  strategy  to  be 
introduced  in  Section  IV  requires  that  component  interactions  be  suitably 
limited  and  certain  side  conditions  be  added  to  the  component  control 
objective.  Local  control  problems  can  then  be  solved  without  full 
information  of  the  actions  of  other  component  controllers.  Lagrange 
multiplier  methods  are  used  to  characterize  the  solution  to  the  local  control 
problems . 

In  this  section,  we  are  concerned  with  system  components  whose 
signal  diagram  is  of  the  form 


Figure  1 


Here  A  =  ( I  -  B )  ^  with  B  in  B;  f  in  G,_,  is  a  known  input  signal;  c  in  G,, 

ri  H 

is  an  unknown  input;  u  in  Gy  is  the  component  control;  and  3,  T  denote 
linear  transformations  from  X  to  X.  The  signal  g  represents  the  effect  of 
other  components  upon  the.  given  component.  We  assume  P^g  =  0  and  will 
add  other  conditions  necessary  for  the  solution  of  the  local  optimization 
problems.  ....  ... 

Two  optimization  problems  will  be  considered,  each  is  typical  of  the 
type  of  local  problems  which  must  be  solved  by  the  component  controllers. 
Let  D  belong  to  B;  b  and  Y  be  in  G^;  and  c,  c  be  in  X. 

Local  Optimization  Problem  I.  (LOP  I) 

Minimize  on  G^xG^:  J(u,h)  =  xN^CASu)  +  xN^(C(y-Y)) 

Subject  to:  h  s  A(f*g+3u) 

h(t)  =  b(t)  T-r<t<T 
[Dh]  (T-r)  =  c 
y  =  Th 

given  that  [(l-r*C"X)  ^AgJ(T-r)  =  c  and  D ( I -T*C~T)  ^Ag  =  0. 

Here  the  control  objective  is  to  force  the  response  h  to  agree  with  b 

over  the  terminal  interval  while  at  the  same  time  steering  the  response  y 

along  a  desired  trajectory  Y.  The  conditions  [(l-T*C“2T)  Agj(T-r)  =  c 
n  _i 

and  D(I-T*C“T)  Ag  =  0  summarize  the  information  about  g  that  allows  the 

controller  to  solve  the  optimization  problem.  The  rationale  for  these 

restrictions  will  become  apparent  in  the  proof.  In  the  performance  index 

2 

far  LOP  I  the  term  (C(y-Y))  corresponds  to  the  standard  quadratic 

T  *j  2 

cost  functional  i/g  (y-Y)“dt  whereas  the  term  (ASu)  is  novel  and 

represents  a  penalty  on  the  response  of  the  system  rather  than  a  direct 
penalty  on  the  control  energy. 
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In  order  to  guarantee  the  existence  of  a  feasible  solution,  we  make 
the  following  assumption. 

Regularity  Assumption:  Given  c  in  X  there  exists  a  u  in  and  h  in  G^ 
such  that  h  =  ASu,  h(t)  =  0  for  T-r<t<T,  and  [Dh](T-r)  =  c. 

Recall  that  reproducing  kernel  Hilbert  spaces  are  characterized  by  the  fact 
that  function  evaluation  is  a  continuous  linear  functional.  Consequently, 
the  constraint  set  for  this  problem  is  a  closed  convex  set.  A  slight 
modification  of  the  basic  argument  for  minimum  norm  problems  [5]  yields 
the  existence  of  a  unique  solution  to  LOP  I.  In  order  to  characterize  this 
solution,  LOP  I  can  be  reformulated  as  a  optimization  problem  in  the 
Hilbert  space  G^xG^.  It  should  be  noted  that  the  condition  h(t)  =  b(t) 
for  T-r<t<T  is  equivalent  to  the  conditions  h(T)  -  b(T)  and  (l-P-j-  )(h-b) 

=  0. 

The  Lagrange  Multiplier  Theorem  asserts  that  if  (u,h)  minimizes  J 
subject  to  the  constraints  then  there  exists  elements  X  and  k  of  Gj_j  and  u, 
v  in  X  such  that  Q,,(A35u,  A0u-X)  *  Qu (5h, T*C*C(Th-Y)  *  \  *  (l-P-r  )k  * 
K(  ,T)u  +  D*K(  ,T-r)v)  =  0  for  all  (5u,5h)  in  GyxG^.  Let  k  =  (l-P-p_r)K 
then  PT_rK  =  0-  Using  the  controllability  assumption,  it  follows  that  A8u  = 
(l-PQ)X  and  T*C*C(Th-Y)  *  X  ♦  k  *  K(  ,T)v  ♦  D*K(  ,T-r)v  =  0.  Since 
[C*h]  (t)  =  K(t,T)  h(T)  -  K(Q,T)h(Q)  -  [Ch](t),  one  obtains  after 

eliminating  u  from  the  previous  equation 

X  =  r*C“(Th-Y)  ♦  (1/(1 ♦r) ) K(  ,T)X(0)  * 

(1/(1  *r)  K(  ,T)  [D*K(  ,T-r)v]  (0)  -  D*K(  ,T-r)v  -  k 

and 

(I-P0)X  =  r*c2(rh-Y)  ♦  k,(  ,x(0))  ♦  k2(  ,v)  -  k 


(3.1) 


where  k^t.XCO))  =  [r^l-P^Kf  ,T)X(0)](t),  k2(t,v)  = 

[O-PQK^kC  ,T)  [D*K(  ,T-r)v](0)-D*K(  ,T-r)v}](t)  and  r^l/fTr).  Note 
that  for  fixed  t  in  S  k.j(t,X(Q))  and  k2(t,v)  are  linear  in  X(0)  and  v. 
Since  h  =  A(f*g-Su)  =  A(f*g)  "‘(l-Pg^,  it  follows  that 

h  =  (l-r*C2r)'1(A(f“g)  -  I* C2v  *  k,(  ,X(0))  *  k2(  ,v)  -  x).  (3.2) 

The  constraints  imply  h  =  (I-P-r  )b*P_  h.  Also  the  causal 

i -r  i -r 

n  -1  n  -i 

properties  of  (1-1*0“!)  and  D(!-T*C“T)  together  with  the  fact  that 
P T_ p<  =  0  imply  that  PT_p[(l-r*C2r) ‘1kJ  =  0  and  PT_r(0((-r*C2r) ^k]  =  0. 
Using  these  observations  we  obtain  the  following  linear  system  of  equations 
for  X(0)  and  v: 


b(T-r)  =  [(l-I*C2T)"1Af](T-r)  ♦  c  •  [(l-I*C2r)'Vc2Y](T-r) 

*  [0-r*c2ar)‘1(k1(  ,x(0))*k2(  ,v))](T-r) 

(3.3) 

c  =  [D(l-l*C2I)’1Af](T-r)  -  [D(I-T*C2I)'Vc2Y](Tt) 

♦  [D(l-T*C27)'1(k1(  ,X(0))^k2(  ,v)  }]  (T-r) . 

It  is  apparent  that  the  conditions  [(l-T*C2!)  2Ag](T-r)  =  c  and 

2  -1 

D(I-T*C  I)  Ag  =  0  allow  us  to  solve  for  X (0)  and  v  with  limited  knowledge 
of  g.  Using  the  constraint  (1-Py_p)  (h-b)  =  0  and  the  fact  that  k  -  A(f*g) 
*  k^  (  , X (0) )  *  k2(  ,v)  -  (l-r*C“T)h  *  r*C“Y,  we  obtain  from  (3.1),  (3.2) 
the  following  theorem. 

THEOREM  2.3.  The  pair  (u,h)  in  G^xG^  solves  LOP  I  if  and  only  if  the 
trajectory  h  has  the  form 


h  =  (l-PT.p)b  *  PT_p(l-r*C2T)'',{A(f~g)  -  **C2Y  *  k^  ,X(0))  *  k2(  ,v)} 

(3.4) 
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and  the  control  u  has  the  form 

u  =  w1  ♦  w2  ♦  w3  (3.5) 

where 

w1  =  S^A'Vc^Ih-Y) 

w2  =  B'1A"1(l-r*C2I)(l-PT_r)b 

-3‘1A‘1(l-rtC2T)(l-PT_r)(l-y*C2r)'1{A(f-g)-y*C2Y} 
w3  =  0'1A‘1(i-a^c2y)(PT.r)(i-r*c2T)'1{l<1(  ,x(0))*k2(  ,v)>. 

Here  \(0),  v  satisfy  the  linear  system  of  equations  (3.3)  and  3*^  is  the 
pseudoinverse  of  3. 

In  this  result  the  control  u  is  the  sum  of  three  terms,  a  dynamic  feedback 
w.j,  a  causal  (non-anticipatory)  function  w2  of  the  inputs  b,  f,  g,  Y,  and 
a  open  loop  term  which  depends  on  f,  Y  and  the  constants  c  and  c, 
i.e.,  on  some  knowledge  of  g  on  the  whole  interval  [-r,T-r].  For  the 
implementation  of  such  a  control  law  it  is  assumed  that  the  observations  Jfh 
are  available  for  feedback.  The  system  diagram  with  such  a  control 
strategy  implemented  is  as  follows. 

Figure  2 

One  should  note  for  finite  dimensional  state-space  systems  that  S  =  [0,T], 
and  w2  =0.  A  simple  example  illustrating  LOP  I  is  presented  after  we 
take  up  an  alternate  form  of  the  component  problem. 

Next  we  consider  a  local  optimization  problem  with  the  standard 
quadratic  cost  functional  i/^"|u'|2dt  *  i/^"|y-Y|2dt. 


Local  Optimization  Problem  II.  (LOP  II) 

Minimize  on  G^xG^:  J(u,h)  =  iN“(u)  *  xN“(C(y-Y)) 

Subject  to:  h=f*Bh*g*0u 
h(T)  =  b(T) 

[Dh] (T)  =  c 
y  =  Th 

A  ^  A  A 

given  that  [Ag] (T)  =  c  and  DAg  =  0  where  A  = 
(l-B-eS^Cl-Bj'Vc2!)'1  and  Bh  =  B*h-K(  ,T)[B*h](0). 

In  this  problem  we  must  restrict  attention  to  finite  dimensional,  state 
space  systems.  Let  B  =  aC  with  a,  a  linear  transformation  on  X.  With  this 
restriction  B  as  defined  above  is  in  B ,  hence  (l-B)  ^  exists,  and  we  may 
again  use  the  Lagrange  Multiplier  Theorem  to  characterize  the  optimal 
trajectory  and  control. 

In  order  that  (u,h)  in  G^xG^  solve  this  problem  it  is  necessary  that 
there  exist  multipliers  X  in  and  y,  v  in  X  such  that  QH(5u,u)  * 

QH(Cr5h,C(Ih-Y))  ♦  QH(5h-B5h-g5u,X)  ♦  <[5h](T),y>  ♦  <[D5h](T),v>  = 
QH(u-0*X,Su)  +  QH(r*C*C(Th-Y)^(l-B)*X*K(  ,T)v,5h)  =0  for  all 

(5u,5h)  in  GyxG^.  Consequently,  u  =  (I-Pq)B  X  and  T*C*C(Th-Y)  *  (I- 
B)*X  ♦  K(  ,T)u  *  D*K(  ,T)v  -  0.  One  obtains,  eliminating  y  form  the 
above  equation  X  =  T*C“(Th-Y)  *  B*X  *  K(  ,T)X(0)  -  K(  ,T)[B*X](0) 

*  K(  ,T)  [D*K(  ,T)v]  (0)  -  D*K(  ,T)v.  Thus  X  =  (l-I)_1{I*C2(Ih-Y) 

-  K(  ,T)  X(0)  ♦  K(  ,T)  [D*k(  ,0]v]  (0)  -  D*K(  ,T)v>  and 

(l-P0)X  =  (l-B)’Vc2(Th-Y)  ♦  (l-P0)(l-B)_1{K(  ,T)X(0)  (3.6) 

*  K(  ,T)  [D*K(  ,T)v]  (0) -  D*K(  ,T)v}. 

It  follows  that 


h  =  Af~Ag-A03*(l-3)  '  I*C‘Y*AS3*( I -PQ)  (1-3)  '{K(  /T)X(0) 

*  K(  ,T)  [D*K(  ,T)v]  (0)  -D*K(  ,T)v) 

=  Af  *  Ag  -  A0S*(!-B)‘Vc2Y  *  k„  (  ,X(0))  *  k12C  ,v)  (3.7) 

and 

u  =  0*(I-i)‘Vc2(rh-Y)  *  k13(  ,  X(Q) )  *  k14(  ,v)  (3.3) 

where 

k13(t,X)  =  [0*(l-Po)(i-B)'1K(  ,T)X]  (t) 

k14(t,v)  =  [3*(l-P0)(l-B)'1CK(  ,T)  [D*K(  ,T)v]  (0)-D*K(  ,T)v}](t) 
k11(t,X)  =  [ASk13(  ,X)](t) 
k12(t,v)  =  [ASk14(  ,v)](t). 

For  fixed  t,  k^(t,X),  k.j3(t,X)  are  linear  in  X  and  k12(t,v),  k14(t,v)  are 
linear  in  v.  The  remaining  constraints  yield  the  following  linear  system  of 
equations  for  X(0)  and  v: 

b(T)  =  [Af]  (T)  ♦  c  -  [ASS*(I-B)"Vc2Y](T)  *  k^  (T,X(0))  *  k12(T,v) 

(3.9) 

c=  [DAf]  (T)  -  [DA00*(I-B)"Vc2Y](T)  -  [D{kn(  ,X(0))*k12(  ,v)}](T). 

Again  the  rationale  for  the  conditions  [Ag]  (T)  =  c  and  DAg  =  0  becomes 
apparent. 

THEOREM  2.4.  The  pair  (u,h)  in  GyxG^  solves  LOP  II  if  and  only  if  u 
and  h  are  as  given  in  equations  (3.7),  (3.8)  and  X(Q),  v  satisfy  equations 
(3.9). 


Here  the  optimal  control  is  made  up  of  two  terms:  a  dynamic  feedback  of 
the  difference  between  the  system  observation  and  the  desired  trajectory 
and  an  open  loop  term  depending  upon  the  input  f  and  the  coordination 


parameters  c,  c.  The  structure  of  the  solution  is  depicted  in  the  following 
diagram. 


Figure  3 

To  illustrate  the  significance  of  LOP  I  and  LOP  II,  we  consider  two 
examples. 

Example  3.1  The  problem  is  to  steer  the  solution  of  the  scalar 
equation  h'(t)  =  h(t-l)  *  g^(t)  *  v(t),  t>0  with  initial  position  h(t)  =  1  for 
-l<t£0  to  the  terminal  position  h(t)  =  0  for  l£t£2.  We  assume  limited 
information  about  g^.  The  system  may  be  written  ash=f*g*Bh*u 
or  h  =  A(f*g*u)  with  f(t)  =  1  for  -l<t<2,  g  *  Cg^  and  u  *  Cv.  Here  A  = 
(l-B)~^  with  [Bhl(t)  =  0  for  -l£t<0  and  [Bh](t)  =  /^hCt-lldt  for  0<ts2. 

<7-1 

We  assume  [(l-C~)  Ag](l)  =  c.  A  solution  is  obtained  by  setting  D  =  0, 
b  =  0,  y  =  h  and  choosing  an  appropriate  Y  in  LOP  I.  We  obtain 

f(t)  -1<t<0 

[Af]  (t)  =  f(t)*/*f(T-1)dt  l<t<2 

f(t)*/5f(T-l)dt*/^(t-r)f(t-2)dt  0<t<2 

[A-1f](t)  =  f(t)  -  [Bfl(t)  -1st<2 

0  -l£t<0 

[C2h](t)  = 

/gCt-tlhCOdt  0st<2 
f(t)  -1St<Q 

[(i-cV^Kt)  = 

f(t)  ♦  /^sinh (t-t)f Ct)dt  0£t^2 

and  the  optimal  trajectory  and  control  can  be  determined  from  equations 


(3.3),  (3.4),  and  (3.5). 


Example  3.2  Let  B  =  C  and  consider  the  problem  of  steering  the  scalar 

system  h(t)  =  t  *  [Bh](t)  *  2u(t)  for  0<t<2  from  h (0)  =  0  to  h(2)  =  1 

2 

subject  to  the  constraint  [Dh]  (T)  =  (1/2)/gh(t)dt  =  0.  Setting  g  =  0  and 
y  =  -jh  and  choosing  an  appropriate  Y,  LOP  1 1  may  be  used  to  solve  this 
problem.  One  obtains,  using  Laplace  transforms, 

[Bh]  (t)  =  th (0)  -  /gh(t)dt 

[(l-B)"1h](t)  =  h(t)  -  /Qe'(t"°h(T)dT  *  (1  -e-t) h (0) 

[Ah](t)  =  h(t)  *  /Q[/2sinh/2(t--r)+cosh/2(t-t)]h(T)dx 
[D*K(  ,T)v]  (t)  =  [DK(  ,t)v]  (T)  =  (H-t2/4)v 
and  the  optimal  trajectory  and  control  are  determined  from  equations  (3.7), 
(3.8),  and  (3.9). 

These  examples  are  indicative  of  the  use  of  LOP  I  and  LOP  II.  Frequently 
Laplace  transforms  may  be  used  to  determine  system  operators.  In  more 
general  problems,  our  Hilbert  space  setting  aids  in  the  representation  and 
approximation  of  system  operators  [2],  [12]. 

4.  A  Decentralized  Control  Strategy.  We  will  present  a  decentralized 
control  strategy,  a  scheme  for  coordinating  local  control  decisions,  for 
large  scale  systems  in  which  component  interactions  are  suitably  limited. 
First,  consider  the  two  component  control  system 

h-|  =  f-j  *  B-jhj  ♦  C2h2  *  Pu1 

h2  =  f2  *  Clhl  *  B2h2  *  0U2 

where  the  B’s  and  C’s  are  from  B.  We  can  diagram  the  system  as  follows: 

Figure  4 
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where  A.=(l-B.()  ^  for  i  =  1,  2. 

We  define  two  components  to  be  stably  connected  provided  for  all  g  in 
PnGu  the  condition  C.(I-C“)  ^A.C.g  =  0  holds  for  (i,j>  =  0,2}.  Large 
scale  systems  composed  of  several  components,  each  pair  of  which  is  stably 
connected,  will  be  referred  to  as  stably  connected  systems.  Local  control 
laws  for  stably  connected  systems  can  be  coordinated  by  imposing  side 
conditions  as  in  the  previous  section  and  exchanging  that  information 
among  the  component  controllers. 

For  a  stably  connected  two  component  system,  consider  the  problem  of 
local  controllers  choosing  controls  and  u^,  respectively,  on  the  interval 
0<t<T  which  steer  h^  and  to  zero  over  the  interval  T-r<t^T,  i.e.  LOP  I 
with  b  =  Y  =  0  and  0=1  =  1.  We  are  led  to  the  following  control 
coordination  strategy. 

Coordination  Strategy:  Let  {i,j}  =  {1,2}.  Given  elements  c^  and  c ^ 
from  X  and  f^  and  ^  'n  controller  solves  LOP  I  with  A  =  Aj,  g 

=  C.hy  D  =  D,  =  (l-C2)  Vc.(,  c  =  Cj,  and  c  =  c.. 

2  -1 

In  this  strategy  the  condition  [(l-C  )  ^-|(-'2^2^"^”r^  =  C2  represents 

the  information  that  the  first  controller  must  have  about  the  second 

component  in  order  that  the  local  optimization  problem  can  be  solved.  This 

condition  becomes  a  constraint  on  the  second  component.  Similarly,  the 

condition  [(!-C~)*  A2C1  h.j  ]  (T-r)  =  c^  becomes  a  constraint  on  the  first 

2-1 

component.  The  stably  connected  assumption  implies  that  Dj(l-C“)  Ajg  = 
0  for  each  component  and,  hence,  each  controller  can  solve  its  local 


optimization  problem. 

The  stably  connected  condition  can  be  given  a  geometric 

interpretation  in  specific  cases.  If  Cj  =  0  for  i  :  1  or  2  then  the 


K 


components  are  stably  connected  and  there  is  a  hierarchical  relation 

*>  .1 

between  the  components.  If  Cj  commutes  with  (l-C~)  for  i  =  1  and  2  on 

PqGh  then  the  stably  connected  condition  is  equivalent  to  the  condition 

C.AjC.  =  0  for  {i,j>  =  {1,2}.  If  the  latter  condition  is  not  satisfied  ,  one 

could  argue  that  the  input-output  operator  for  the  first  component  should 

be  ( I -A.j C?A.j  C.j )  ^A.j  rather  than  A^.  Similarly  for  the  second  component. 

For  the  examples  considered  in  this  paper  Cj  =  aC  with  r>0  or  r=0,  where 

0  -1 

a  is  a  dxd  matrix,  in  either  case  C.  commutes  with  (l-C“)  on  PnGu.  For 

l  U  H 

finite  dimensional  state  space  systems  i.e.,  r  =  0  and  =  “i-jC,  C7  = 
0^2 C,  =  a2l^'  an<^  =  °jj  matrices  of  appropriate 

dimensions  the  two  components  will  be  stably  connected  if  and  only  if  the 


controllability  subspace  determined  by  {a.., cc..}  is  a  subspace  of  the  null 


space  of  a.j  for  {i,j}  =  (1,2). 

Other  combinations  of  LOP  I  or  LOP  II  can  be  used  as  the  basis  for 


defining  a  coordination  strategy.  In  any  such  strategy,  if  D-(  denotes  the 
operator  appearing  in  the  additional  component  constraint  then  we  must 


extend  the  definition  of  stably  connected  components  to  mean  0^2  s  ^2^1 
=  0.  Frequently  the  components  form  a  hierarchy  in  which  =  0  or  D2  = 
0  and  this  condition  is  automatically  satisfied. 


Example  4.1  Consider  the  decentralized  control  problem  of  steering  the 
two  component  system 

h  1  * (t)  =  h1 (t-1)  *  h2(t)  ♦  V] 
h2'(t)  =  h2(t)  *  v2 

from  h^(t}  =  1  for  -1<t<0  to  h^(t)  =  0  for  1st<2  and  h2 CO )  =  0  to  = 

1.  With  notation  as  in  Examples  3.1  and  3.2  the  system  may  be  written  as 


h,  =  f  ♦  B,h, 


Ch-  +  u 


Cleariy  the  components  form  a  hierarchy.  The  following  coordination 
strategy  is  suggested:  the  controller  for  the  first  component  uses  LOP  I, 
as  in  Example  3.1  with  g  =  to  determine  u^  while  the  second 

controller  uses  LOP  II,  as  in  Example  3.2  with  D  =  (l-C~)  A^,  to 

determine  u-,. 


The  implementation  of  our  coordination  strategies  for  a  two  component 
system  requires  that  appropriate  values  for  the  parameters  c^  and  C2  be 
available.  These  parameters  are  referred  to  as  coordination  parameters 
and  the  problem  of  determining  values  for  these  parameters  leads  to  a 
higher  level  coordination  problem. 

A  coordinating  strategy  can  be  developed  for  any  stably  connected 
system.  A  rich  class  of  such  systems  are  those  which  can  be  thought  of 
as  hierarchies.  A  canonical  example  is  a  multi-component  system  with 
signal  diagram  of  the  following  form 


Figure  5 


Clearly  each  pair  of  components  is  stably  connected  and  we  can  envision  a 

command  structure  where  the  controller  for  the  first  component  sets  the 

coordination  parameters  and,  hence,  the  side  conditions  for  the  other  two 

components,  i.e.,  specifies  the  values  of  [(I-C“)  and  [  ( I  - 

■7.1 

C“)  A^C2h2](T)  if  LOP  I  is  used.  More  generally,  we  can  consider  a 

grid  network  of  the  form 


Figure  6 


provided  the  system  is  stably  connected.  The  side  conditions,  using  LOP 
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I,  would  have  the  following  form. 

,  n  .1 

On  the  first  component:  [(l-C~)  A2C^h^](T)  = 

*>  -i 

On  the  second  component:  [(l-C  )  A^C2-jh2](T)  =  c0^ 

and  [(l-C2)'1A3C23h2](T)  =  C23 

On  the  third  component:  [(l-C2)  ^A2C3h3](T)  =  c^. 

Physical  limitations  on  component  interactions  can  yield  stably 
connected  systems  or  decomposition  methods  may  be  used  to  transform  a 
model  into  a  stably  connected  system.  We  now  present  a  basic 
decomposition  procedure  for  finite  dimensional  systems  of  the  form  h(t)  = 
f(t)  *  cd'gh(s)ds  *  +  &2u2  w^ere  r  =  0  and  a  is  a  dxd  matrix  and  &. 

is  a  dxn.  matrix  for  i  =  1,2.  See  [11]  for  examples  of  this  decomposition 
and  related  coordination  problems.  For  i=1,2  let  IL  denote  the  projection 
of  X  onto  the  controllability  subspace  spanned  by  the  columns  of  the 
matrix  ,a^  ^3j}  and  a  projection  of  X  onto  I^X  (II^X. 

Assume  X  =  II^X  +  I^X  and  recall  that  the  identity  may  be  written  as  I  ~ 

ni  *  n2  ’  II3’ 

We  want  a  decomposition  of  the  system  in  terms  of  the  H's  to  which 
we  can  apply  our  distributed  control  strategy.  For  0£  m^,  m^,  m2  £1 ,  let 

f1  =  (ILj-rngll^f  f2  =  (^-O-mQjILjK 


a-j  ^  —■  (  —  m  ^  ILj  ]all1  ^12™  m2  *^2 

821  —  m^n^ctU^  —  ( H2 *" ^2^3 ^ * 

Furthermore,  let  =  o^C,  =  ®21^'  ®2  =  a22'  ^2  =  °12^‘  ^ur 
decomposition  has  the  form 

h,  =  f,  *  B,h,  *  C2h2  *  B,u, 

1^2  ~  ^2  *  ^1^1  *  ^2^2  *  ®2u2‘ 

It  follows,  using  the  invariance  properties  of  the  controllability  subspaces. 


that 


hi-]  ^2  ~  ^1  *  ^2  *  (an*a21)/0hldt  *  ^a1 2*a22^0^2d^'*  ®1ul  *^2U2 
=  f  *  II^all^/Qh^dt  *  ^a^/Q^^dt  *  8-jU^  *  ®2U2 


-  f  *  II.ja/Qh^dt  ♦  *  8-jU^ 

=  f  *  (ni-K3)a/Qh1dt  ♦lLjo/Jl^dt 


hu2 


♦  (^-ILjWQh^dt  ■"I^a/ gh^dt  +  3^ u-j  +  ^2 
=  f  *  (Il^l^-I^WjCh^l^dt  +  8-jU.j  ♦  ®2u2‘ 

Thus  h  =  h.j  *  h2  and  the  decomposition  can  be  diagramed  as  follows: 

Figure  7 

where  A.  =  (l-ET)  ^  ,  i=1,2. 

The  system  will  be  stably  connected  provided  C^A^C2  =  *-2A2C^  =  0. 
Here  ^2^2^!  =  (I-U^-rr^I^al^C)  and  a  similar 

expression  holds  for  C^A^C2- 

We  consider  three  cases  i)  ILjX  fl  =  {0>;  ii)  II2X  9H-|X;  and  iii) 
H^X,  n2X^X,  n^Xn^XKO).  If  y  =  (K^^n^cr^cr^llja^x  then 
the  invariance  properties  of  the  controllability  subspaces  imply  that  H^Cy  = 
Il^Cy.  Consquently,  the  stably  connected  condition  is  satisfied  for  all 
.choices  of  m^  and  m2  whenever  =  0«  1°  the  first  case  =  0  and 

there  is  no  interaction  between  the  components.  In  the  second  case  = 
II2  and  the  situation  seems  to  be  most  interesting  when  H^all^  t  0.  In  this 
case  the  stably  connected  condition  can  be  met  by  choosing  either  m^  or 
m2  to  be  zero  forming  a  "hierarchical"  system.  Finally,  the  third  case  is 
mixed  since  H^al^  rnight  or  might  not  be  zero.  When  H^al^  =  ®  an<^  mim2  * 
0  note  that  the  system  is  not  a  hierarchy  and  the  components  interact. 


5.  Concluding  Remarks.  If  one  views  the  system  components  as  basic 
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building  blocks  then  our  coordination  strategy  for  stably  connected 
systems  may  be  viewed  as  a  rule  for  putting  together  more  complex 
structured  systems.  From  this  point  of  view  the  open  and  closed  loop 
control  laws  arising  from  the  local  optimization  problems  determine 
additional  components  to  be  "hardwired”  into  the  system. 

To  implement  such  a  control  strategy  one  may  envision  a  coordinator 
who  acts  or  may  act  on  the  system  by  setting  the  component  objective: 
trajectories,  or  side  conditions  necessary  for  coordination.  terminal 
constraints,  desired  trajectories ,  or  side  condition  necessary  for 
coordination .  Such  a  coordinator  may  use  centralized  knowledge  of  the 
performance  of  each  component  to  set  coordination  parameters.  Realisticly, 
only  limited  information  on  component  performance  would  be  available  to  the 
coordinator.  Another  possibility  is  that  a  command  structure  is  imposed 
among  the  the  system  components  for  the  choice  of  component  objectives 
and  the  passage  of  information.  There  are  many  possibilities.  However, 
the  basic  idea  is  that  in  any  such  structure  there  is  a  predetermined  order 
in  which  component  objectives  are  to  be  set.  Certain  components  may  be 
free  to  set  their  own  objectives  while  other  components  would  have  extra 
side  conditions  added  to  their  requirements. 


mm 
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ABSTRACT 

A  control  strategy,  which  allows  some  level  of 
autonomous  component  control,  for  large  scale 
systems  Is  presented.  The  approach  requires  that 
component  interactions  be  suitably  limited  so 
that  variational  methods  can  be  used  to  determine 
component  controls. 

INTRODUCTION 

Decentralized  control  problems  for  large  scale 
finite  dimensional  linear  systems  are  considered. 
For  systems  with  two  controllers  we  consider  the 
problem  of  Independently  choosing  controls  to 
steer  component  responses  to  desired  terminal 
conditions.  It  Is  shown  that  some  level  of 
autonomous  component  control  Is  possible  when 
additional  constraints  are  placed  upon  the 
component  requirements  and  exchanges  of  related 
Information  between  components  Is  allowed.  The 
ability  to  coordinate  locally  designed  control 
laws  depends  on  the  level  of  Interaction  between 
system  components. 

Our  methods  may  be  referred  to  as  multi-level  or 
hierarchical,  (1),  (2),  in  the  sense  that  1)  the 
system  must  be  decomposed  Into  local  components, 
11)  local  models  are  used  in  the  design  of 
component  control  laws  ,  111)  a  higher  level 
coordination  problem  Is  Introduced.  Typically 
multi-level  methods  Involve  off  line  Iterative 
calculations  and  result  In  open  loop  controls. 
In  our  appraoch  coordination  of  component 
controls  Is  achieved  In  one  step  by  the  Imposi¬ 
tion  of  additional  constraints  on  the  system 
components  and  closed  loop  control  laws  are 
obtained.  The  choice  of  appropriate  values  for 
parameters  appearing  in  these  added  constraints 
leads  to  a  higher  level  coordination  problem. 

COMPONENT  CONTROL  PROBLEM 

Our  methods  require  that  components  modelled  by 
differential  equations  be  written  In  Integrated 
form  as  h(t)  -  f(t)  +  [Bh](t)  *  8u(t)  ♦  g  j  <  t )  and 
y(t)  -  Yj  h  ( t )  +  TjE  2  ( t ) ,  where  [8h](t)  -  a[Ch](t); 


*  Research  supported  In  part  by  the  Air  Force 
Office  of  Scientific  Research  under  Grant 
AF0SR-8«-0236. 


with  [Ch] ( t )  -  Jgh(i)dT  an<  a,  B,  Y, ,  Y2,  denote 

matrices  of  appropriate  dimension.  Here  u 
denotes  the  component  control ,  f  denotes  a  known 
disturbance  and  g, ,  g2  denote  the  effect  of  other 
components  upon  the  given  component.  Let  A  - 
(  I  —  B  )  —  1  denote  the  component  Input-output 
operator . 

We  consider  the  problem  of  steering  h(t)  from 
h(0)  -  f (0)  to  a  desired  terminal  condition  h(T) 
»  b.  Let  c,  c  denote  fixed  parameters  and  let  D 
denote  a  linear  operator  defined  on  the  undet — 
lying  function  space.  The  typical  form  of  a 
component  optimization  problem  is  as  follows: 

Minimize:  J(u,h)  -  ^Jg(y-Y)2  *  (u'  )2dt 

Subject  to:  h(t )  -  f(t)  ♦  [Bh](t)  ♦  Bu(t)  +  g  (t) 
h(T)  -  b 
[Dh](T)  -  c 

y(t)  -  Y^ h ( t )  ♦  Y2g2(t) 

given  [A(g1+BY2g2](T)  -  c  and  d( A(g1  ^BY^) )  -  0 
where  operators  A  and  B  are  defined  by 
A  -  (I-B-BY,)-1,  B  -  BB*(I-B)-1 Y*c2,  and 
[Bh](t)  -  [B*h](t>  -  K(t,T)[B*h](0) . 

In  this  problem  an  interval  constraint  has  been 
placed  upon  h,  Y  denotes  a  desired  response,  and 
K(s,t)  -  k (min (s  ,  t ) )l  with  I  the  identity  and 
k(t)  -  1*t.  The  conditions  [A(gj+BY2g2)](T)  -  c 
and  D ( A (  g  i  *B  Y2g2 )  )  -  0  summarize  information 
about  gi  and  g2  that  allow  the  controller  to 
solve  this  optimization  problem.  These  condi¬ 
tions  will  become  added  constraints  on  the  compo¬ 
nents  which  determine  gi  and  g2.  For  a  similar 
reason  the  constraint  [Dh](T)  -  els  included  In 
the  above  problem.  For  certain  hierarchical 
relations  between  system  components  the  condition 
D(A(gi+BY2g2) )  -  0  is  naturally  satisfied. 

The  local  control  problem  can  be  reformulated  as 
a  constrained  optimization  problem  in  a  reproduc¬ 
ing  kernel  Hilbert  space  of  functions.  The  inner 
product  In  this  space  is  essentially  defined  by 

:'f,g>H  -  <f(0),g(0)>  ♦  Jg<f'(t),g' (t)>dt. 

Lagrange  multiplier  methods  (3),  yield  the 
optimal  control 


[Dh2](T)  -  [A^ Y2h2](T)  -  c. 


u(t)  -  [8»(I-B)'1Y*C2(Y1h+Y2g2-Y)](t) 

♦  k( (t,A)  +  k2(t,v) 

where  the  open  loop  terms  are  defined  by 
k^t.l)  -  CS*(I-P0)(I-B)“1K(  ,T) A ] ( t ) 
k2(t,v)  -  C  B*(I-P0) (X-B)_1 {K(  ,T)[D»K(  ,T)v](0) 

-  D»K(  ,T)\»)](t). 

With  this  control  strategy  implemented  the  system 
response  is 

h(t)  -  Af*A(g]*BY2g2)-ABY*A8(k1 (  ,A)*k2<  ,v)). 

and  the  multipliers  A,  u  are  solutions  of  the 
equations 

b  -  [Af](T)*c-[ABY](T)*[AB{k)(  ,A)*k2(  ,u)]](T) 

0  -  [DAf](T)-[DABY](T)+[DAB{k1(  ,A)*k2(  ,v)}](T). 

Here  Kl-P0)f](t)  -  f(t)  -  f(0)  and  [B»h](t)  - 
a»[K(t,T)h(T)  -  K ( t , 0 )h( 0 )  -  [Ch](t).  In  the 
scalar  case  [D*K(  ,T)v](t)  -  [DK (  ,t)v](T)  and  in 
the  vector  case  [D*K(  ,T)v](t)  is  determined  by 
<[D*K(  ,T) u] ( t )  ,  ej>  -  <[DK(  ,t)ej ](T) ,v> . 

For  low  order  systems  all  operators  arising  in 
the  component  control  problem  can  be  obtained 
using  Laplace  transform  methods.  Higher  order 
systems  require  numerical  approximations  to  these 
operators.  Theoretical  verification  of  the 
existence  and  uniqueness  of  solutions  to  local 
control  problems  of  the  above  form  is  the  subject 
of  a  forthcoming  paper  (4). 

CONTROL  COORDINATION 


As  an  example  of  our  coordination  strategy  we 
consider  the  following  two  component  system 


Here  A^  *  (I~Bj[)-^  with  B^  ■  ajC  and  C21  *  2^ 
where  cq  and  1112  are  matrices  of  appropriate 
dimension  for  1  -  1,2.  The  control  problem  is  to 
choose  ui  and  U2  to  steer  hj  and  h2  from  given 
initial  positions  to  desired  terminal  conditions 
h](T)*bj  and  h2(T)-b2  with  limited  information 
exchanged  between  components. 

The  following  coordination  strategy  is  suggested. 
The  first  controller  solves  the  local  control 
problem  with  gi*C2ih2«  g2my2h2>~  and  D  -  CL  This 
strategy  forces  the  constraint  [ A 1 ( C 2 1  8)  Y 2^ 2 1 
(T)  -  c  on  the  second  component.  Also,  the 
second  controller  can  obtain  a  control  to  meet 
the  desired  objective  by  solving  the  local  con¬ 
trol  problem  with  g  *  g  -  0  and  the  constraint 


For  example,  to  steer  hi  from  hi ( 0 ) -0  to  hg (T)— bi 
and  h2  from  hjCOi-O  to  h2(T)-b2.  the  component 
optimization  problems  would  be 

I.  Minimize:  ^/Q(Yih1+Y2h2-Y1  )dt  +  '4Jgu|  (t)2dt 
Subject  to:  h1  -  B^  +  C21h2  +  8,^ 

h^T)  -  b1 

.  y  I  Vi  +  V2  „ 

given  [A1 (C21*B1 Y2)h2](T)  -  c, 

II.  Minimize:  ^/q( Y^-Y^dt  +  ^ujtVdt 
Subject  to:  h2  -  B^  +  b2u2 

h2(T)  -  b2 

[A1(C21*B,Y2)h2](T)  -  c 


Note  that  each  local  control  problem  can  be 
solved  independently  provided  that  the  operator 
Ai(C2i*BiY2)  and  the  value  of  c  is  known  to  each 
controller.  The  choice  of  appropriate  values  for 
this  coordination  parameter  leads  to  a  higher 
level  coordination  problem. 

This  example  illustrates  our  approach  to 
decentralized  control  and  control  coordination 
for  large  scale  systems.  In  the  scalar  ca3e, 
operators  which  appear  in  thl3  coordination 
strategy  have  the  following  representation 


[BhJ(t)  -  c(th(0)  -  [Ch](t) ) 
[(I-B)~'h](t)  -  (1-e"at)h(0)  +  h(t) 


rt  -a(t-x) 


h( x)dx 


[C2h](t)  -  Jg(t-x)h(T)dT 

[Bh](t)  -  (1/a)  Jg(l-e'a(t'T)}Yh(T)dT 


and  A  is  the  input  output  operator  with  transfer 
function  (s^+as )/ (s^- ( a^+ B^Y^) .  These  formula 
can  be  used  to  simulate  our  coordination  strategy 
for  two  component  systems  a3  diagrammed. 
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Reproducing  kernel  Hilbert  space  methods  have  produced 
useful  approximations  for  estimation  and  control 
problems  of  deterministic  linear  hereditary  systems. 

By  obtaining  explicit  parzen  type  RKH  space 
representations  of  stochastic  processes  governed  by 
linear  hereditary  systems  as  spaces  of  Hellinger 
integrable  functions  these  same  approximation  methods 
apply  to  the  problem  of  finding  the  covariance  kernel 
given  the  model.  Some  sample  calculations  will  be 
presented. 


INTRODUCTION 

A  convenient  summary  of  the  inner  product  space  geometry  of  second  order 
stochastic  processes  can  be  found  in  [3,  Chapter  2].  Our  concern  is  with  the 
covariance  kernel  of  such  a  process,  the  reproducing  kernel  of  a  Hilbert  space 
representation  of  the  process  [5].  A  recent  collection  of  papers  [9]  covering 
the  last  two  decades  illustrates  the  utility  of  RKH  space  methods  for 
computing  various  functionals  of  a  process  related  to  problems  of  estimation 
and  detection. 

The  covariance  kernel  also  plays  a  central  role  in  the  design  of  controls  for 
linear  finite  dimensional  state  space  systems  [8].  In  this  work  the  diagonal  of 
the  kernel  function,  the  variance  of  the  system  response  to  a  general  noise 
process,  is  most  important  and  can  be  found  by  solving  a  matrix  Riccati  equation. 
However,  for  hereditary  systems,  systems  modelled  by  delay  differential  equations 
for  instance,  the  covariance  kernel  has  not  been  so  useful.  One  difficulty  is 
that  infinite  dimensional  state  space  methods  lead  to  an  operator  Riccati  equation 
for  the  variance  of  the  states  [2]  rather  than  the  variance  of  the  process. 

The  approach  of  this  paper  to  the  problem  of  estimating  the  covariance  kernel 
of  the  response  of  an  hereditary  system  to  a  general  noise  process  input  is  in  the 
spirit  of  parzen’ s  original  idea.  We  extend  the  method  presented  in  [7]  for 
scalar  systems  to  obtain  an  explicit  description  of  the  reproducing  kernel  Hilbert 
space  representing  the  process  as  a  space  of  Hellinger  integrable  functions  [4]. 
Convergence  of  a  class  of  finite  dimensional  approximations  to  the  covariance 
kernel  is  obtained  using  the  approximation  theory  developed  in  [6]. 
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SOME  BACKGROUND  NOTATION 


We  are  concerned  with  second  order  processes  { X ( t ) ,  t  in  s}  with  values  in 
Rd,  i.e.f  the  components  of  the  dxd  matrix  E(x(t)X'(t))  are  finite  for  each  t. 
Let  <•,•>  denote  the  usual  inner  product  for  Rd  and  |  •  |  the  inner  product  norm. 


Parzen's  covariance  kernel  R  is  defined  by  R(s,t)  =  e(x(s)X' (t) ) ,  for  each  s 

and  t  in  S.  One  has  immediately  that  £n  ,<c  ,R(s  ,s  )c  >  >  0  for  each  sequence 

p,  q=0  p  p  q  q  - 


fs  f  n„  in  S  and  sequence  {c  }  n„  in  Rd.  Aronszajn's  classic  result  [1]  tells 
1  p  p»0  p  p=U 


us 


that  there  is  a  complete  Hilbert  space  G  for  which  R  is  a  reproducing  kernel , 
i.e.,  denoting  the  inner  product  by  Q(*,«)  we  have 

i)  R (  ,t)c  is  in  G  for  each  t  in  S  and  c  in  Rd  and 
ii)  Q(f,  R (  ,t)c)  =  <f(t),c>  for  each  f  in  G,  t  in  S,  and  c  in  Rd. 

It  is  appropriate  to  think  of  { G , Q }  as  a  representation  of  jx(t),  t  in  s} 
since,  for  each  c  in  Rd,  the  function  ijjc  from  L2(x(t),t  in  s)  into  { G , Q } 
defined  by  tc(u)  -  E(Xu' )c  maps  X(t)  to  R(  ,t)c,  for  each  t  in  S.  However, 
obtaining  {g,Q}  explicitly  is  basic  to  making  use  of  this  representation  of 
the  process. 

Consider  for  instance  the  process  given  by  the  real  valued  stochastic 
differential  equation  dX  =  aX(t)dt  +  dW  where  W  is  the  standard  Wiener 
process.  The  covariance  kernel  for  {x(t),  t  0 }  is  given  by  R(s,t)  » 
(1/a)exp(a  max(t,s))*  sinh(ot  min(t,s)),  for  s,t  in  S  ■  [0,®).  The 
corresponding  RKH  space  G  is  the  space  of  all  functions  f  which  are  0  at  0, 
absolutely  continuous  on  compact  subintervals  of  S,  and  such  that 

f“  |  f'(t)  -  af(t)  |  2  dt  <  ®.  The  inner  product  Q  is  given  by 
Q(f,g)  -  J“(f'(t)  -  af(t)(g'(t)  -  ag(t ) )dt  for  each  f  and  g  in  G. 

This  elementary  result  can  be  generalized  to  include  delay  systems. 
However,  Parzen's  ideas  apply  to  more  complicated  systems  which  we  will 
attempt  to  encompass  by  introducing  an  abstract  formulation.  Assume  S  » 

[-r,®)  where  r  >  0  and  k  is  an  increasing  function  from  S  to  the  numbers  with 
k(-r)»0.  Let  Gq  denote  the  space  of  continuous  Rd  valued  functions  on  S  and 
Gfl  the  subset  of  Gq  to  which  f  belongs  only  in  case  f(-r)  =  0  and  f  is 
Hellinger  integrable  with  respect  to  k  on  compact  subintervals  of  S  [4,6], 
i.e.,  for  each  compact  subinterval  [u,v]  of  S  there  is  a  number  b  such  that 

Ea  j  df  |2/dk  -  E  ^  |  f (Sp)-f (sp_1 )  |2/(k(sp)-k(sp_1  ))  <  b  for  each  partition 
(Sp^Q  of  Cu>v]*  The  Hellinger  integral  j  df  j2/dk  is  the  least 


such  number  b. 


Note  that  elements  of  G^  are  absolutely  continuous  on  compact  subintervals  of 
of  S.  Furthermore,  if  each  of  f  and  g  is  in  G^  and  [u,v]  is  a  compact  subinterval 


i 


e  V 

then  the  integral  Ju<df,dg>/dk  exists  as  a  limit  through  refinement  of  partitions 
of  [u,v]  of  approximating  sums  of  the  form  t  <df,dg>/dk  =  z  m,<f(s  )-f(s  ,  ), 

3  p=l  p  p-1 

g(sp)-g(sp_1 )>/(k(sp)-k(sp_1 )). 

For  each  u  in  S  and  f  in  Gq  let  N  (f)  =*  l.u.b.  j  f(x)  |  and 

x  <  u 

1  f(x)  x  <  u 

[p  f](x)  - 

'  f  ( u )  u  <  X. 

Let  denote  the  class  of  linear  transformations  of  Gq  to  which  B  belongs 
only  in  case 

i)  [Bf](u)  *  0  for  each  f  in  Gq  and  u  <  0  and 
ii)  for  each  compact  subinterval  So  of  S  there  is  a  number  c  such  that 

|  [Bf ] ( v)  -  [Bf ] (u)  J  <  c  IyNx(f )dk(x) ,  for  each  f  in  Gq  and  subinterval  [u,v]  of 
So* 

u  <  0 
0  <  s, 


where  a  and  3  are  d*d  matrices,  restricted  to  Gq  is  in  8. 

Let  A  denote  the  space  of  linear  transformations  of  G0  to  which  A  belongs 
only  in  case  A  -  I  is  in  8,  where  I  also  denotes  the  identity  transformation  on  Gq 
If  B  is  in  8  then  I-B  is  a  reversible  function  from  Gq  onto  Gq  and  (I-B)-1  is  in  A 
If  A  is  in  A  then  A  is  a  reversible  function  from  Gq  onto  Gq  and  I -A-1  is  in  B. 

Consider  the  process 
(Z(t) 

X(t)  - 

<  Z(t )  H-  [BX](t) 

-  [AZ ] ( t )  , 

where  B  is  in  8,  A  *  (I-B)-1,  and  Z  is  a  mean-zero  process  in  Rd  with  independent 
increments,  and  E(dZ(dZ)’)  =  (dk)l,  I  the  dxd  identity.  We  assume  that  Z(-r)  »  0. 
In  the  next  section  we  want  to  obtain  explicitly  an  RKH  space  which  represents  the 
process  { X ( t )  ,  t  in  s}  in  the  sense  of  Parzen. 


t  <  0 
0  <  t 


Note  that  the  formal  integral  operator 
i  0 


[Bf ] (u) 


a  J^f (s )dk(s )  +  gj^f (s-r)dk(s) 


AN  RKH  SPACE  PARAMETERIZATION  OF  R. 


We  begin  with  a  generalization  of  the  earlier  elementary  result  for  the  pro¬ 
cess  given  by  X(t)  =  W(t)  +  ajt  X(s)ds.  Let  G  denote  the  subset  of  G„  to  which  f 

O  ®  ri 

belongs  only  in  case  J"  j  df  |Vdk  <  ®  and  Q  the  inner  product  for  G  given 

—  p  I  I  ao  co 

by  Q  (f,g)  =*  J"  <df,dg>/dk.  Recall  that  elements  of  G  are  0  at  -r. 

a»  — p  hi 

Theorem.  If  R(  ,t)c  is  in  GH  for  each  t  in  S  and  c  in  Rd  then  the  process 
{x(t) ,  t  in  s(  given  above  can  be  represented  in  the  sense  of  Parzen  by  the  RKH 
space  {G,Q}  where 

1)  G  is  the  subspace  of  G„  to  which  f  belongs  only  in  case  (I-B)f  is  in  G  and 

H  00 

2)  Q  is  the  inner  product  for  G  given  by  Q(f,g)  =  Q  ((I-B)f,  (I-B)g)  for  each 
(f ,g)  in  G*G . 

Indication  of  Proof.  As  an  indication  that  everything  works,  notice 
that  there  is  a  function  M  from  S  S  to  the  d  d  matrices  such  that  X(t)  = 

[AZ )  ( t )  =  J^M(t,s)dZ(s)  for  each  t  in  S  and 

0  if  t  <  u  <  v 

E  ^  dZ ( u , v ) ( [AZ ] ( t ) ) ' )  = 

J^M' (t,s)dk(s)  if  u  <  v  <  t. 

Also  if  s  <  t  and  c  in  Rd  then 

[(I-3)R(  ,s)c](t)  =•  [(I-B)E(X(-)  X'  (s)  )c]  (t) 

-  [E(Z(0  X'  (s)]c](t) 

>  [E(Z(  •)  X' (s)]c](s) 

-  [(I-3)R(  ,s)c](s)  , 

i.e.,  ( I — B ) R (  ,s)c  is  in  G  or  R(  ,s)c  is  in  G  for  all  s  in  S  and  c  in  Rd. 

CO 

Furthermore,  if  c-|  and  C2  are  d- vectors, 

<c1 ,R(s ,t)c2>  =  <ci  ,e(x(s)X* (t))c2> 

=  <o1 ,e( J^pM (s ,u)dZ (u) ) ( J^rM ( t , v)dZ ( v) ) ' )c2> 

=■  <c1  ,  /frM(s  ,u)M' (t  ,u)dk(u)c  > 

=■  J3  <M'(3,u)c  ,M'(t,u)c  >dk(u) 


: 

i 


'i 

5 


$ 

I 


i 


a 


9 

3 


=  J"r<dE (z ( • )X' (s))c1 ,dE(z(-)X'  (t)]c2>/dk 
=  Q  ((I-B)R(  ,  s )  c  ,  (I-B)R(  ,t)cj 

OS  1  ^ 

=  Q(r(  , s ) c 1 ,  R (  ,t)c2) . 

Let  K  denote  the  function  from  S*S  to  the  dxd  matrices  given  by 

(  k(s  +  r)I  s  £  t 

K(s ,  t )  =  \ 


k(t  +  r)l 


t  <  s . 


Note  that  K  is  the  reproducing  kernel  for  {G^.Q^}. 

Theorem.  For  s  <  t,  R(s,t)  =  [A(PtA)*K(  ,t)](s). 

Proof.  Since  P^A  is  a  continuous  linear  transformat ionof  {g  ,Q  },  we  have 

the  adjoint  (PtA)*  exists.  Also  AK(  ,s)  is  in  G  for  each  s  in  S.  Hence,  for 
arbitrary  d- vectors  c-|  and  C2  and  s  <  t  in  S, 

<[AK(  ,s)](t)Cl  ,c2>  =  Q(aK(  .s)^,  R(  ,t)c2) 

=  |^r<dK(  ,s)c1  ,d(I-B)R(  ,t)c2>/dk 

=  <c1 ,[(I-B)R(  ,t)](s)c  >  . 

On  the  other  hand, 

<[AK(  ,s)](t)c1 ,c2>  -  Qw(AK(  , s ) c 1 ,  K(  ,t)c2) 

=■  Q^CKC  , s ) c 1  ,  (PfcA)»  K(  ,t)e2) 

=  <c1 ,[(PtA)»  K(  ,t)](s)c2>  . 

Since  c^  and  c2  are  arbitrary,  P3 C I— B )  R(  ,t)  -  P3(PtA)*  K(  ,t).  But  then 
P3AP3(I-B)R(  ,t)  -  PSR(  ,t)  -  PgA^A)*  K(  ,t)  or  R(s,t)  - 
CA(PtA)»  K(  ,t)](s). 

We  might  note  this  can  also  be  written  <R(s ,t)c, ,c_>  -  Q  (K(  ,s)c.  ,  A(P^A)*' 

It®  I  U 

K(  ,t)c_]  -  Q  ((P_A)*K(  ,s)c,,  (Pv A ) *  K(  ,t)c  ).  If  we  introduce  the  matrix  L 
defined  by  L(s,t)  -  [(P  A)»  K(  ,t)](s)  -  [Pt(PfcA)»  K(  ,t)](s),  then  L(s,t)  - 
L(t,t)  when  s  >  t,  L(  ,t)c.  is  in  G  for  i-1,2,  and  <R(s,t)c, ,c_>  - 

—  X  ®  .  It 


Q„(L(  ,s)c1 ,  L(  ,t)c2) 


il 


NUMERICAL  METHODS. 


For  the  purpose  of  illustration  assume  that  everything  is  scalar 
valued,  i.e.,  d  =  1,  and  k=  I  the  identity  on  S.  Computing  [diag  R](t),  for 
a  given  t,  splits  into  two  parts.  We  are  concerned  first  with  function 
evaluations  L(s,t)  =  [aK(  ,s)](t)  and  then  with 

the  integral  Q<b(l(  ,t),L(  ,t))  =*  |  dL(  ,t)  j2/dl.  Working  backward,  observe 

that  the  approximating  sums  Z  n,  I  L(s  ,t)  -  L(s  , ,t)  |2/(s  -s  ,)  for  the 

p=1  1  p  p-1  1  p  p-1 

intergral  are  nondecreasing  with  respect  to  refinement  [4], 

If  Sp-Sp_1  =  <5  >  0  for  p  =  1 ,  2,  ....  n,  e  is  a  positive  number,  and  L(  ,t) 

is  an  approximation  for  L(  ,t)  such  that  |  L(s  ,t)  -  L(splt)  |  <  e  for  p  = 

1  ,2 . n,  then  |  |  L(sp,t)  -  L(sp_1  ,t)  |  2/6  -  Ip=1  |  L(s  ,t)  - 

L (s  ,t)  |  2/6  !  <  4e[2Nh(L(  ,t)+e]/6. 

P“*  l  O 

Thus,  assuming  the  operator  A  is  given  formally  by  an  integro-diff erential 
equation,  we  can  compute  for  a  fixed  partition  {3p}p^Q  of  [~r»t]  the 

approximating  sum  I  |  dL(  ,t)  |2/dl  to  any  desired  accuracy.  By  refining 

s 

in  turn  the  partitions  s  we  obtain  [diag  R](t). 

The  method  wa3  implemented  for  the  class  of  scalar  systems  of  the  form 

h(t)  -  f(t)  +  a/Qh(u)du  +  bJqMu-^  )du  +  Yj^hCu-r^du. 

Experiments  with  t  -  2,  r^  -  1/2,  ^2=1,  and  various  values  of  a,  B.  and  y ,  -2  < 

a,  3,  Y  £  2,  the  algorithm  always  converged  with  err  ■  0.001,  i.e.,  halving  the 
step  3ize  for  the  function  evaluation  and  the  integral  quadrature  produced  no 
change  in  in  the  first  four  decimals  of  [diag  R](t). 

CONCLUSIONS 


RKH  space  methods  lead  to  an  explicit  representation  of  the  convariance 
kernel  for  a  process  governed  by  an  integro-diff erential  equation  in  terms  of 
solutions  that  can  be  obtained  by  standard  numerical  methods.  Although  the 
presentation  of  these  methods  for  the  sake  of  clarity  was  in  terms  of  scalar 
systems,  the  methods  are  readily  extended  to  finite  dimensional  vector  systems. 

The  relative  straightforward  nature  of  these  methods  leads  one  to  anticipate  their 
incorporation  into  a  general  methodology  for  system  identification  and  control 
design  ; or  hereditary  systems. 
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CANONICAL  FORMS  FOR  DECENTRALIZED  CONTROL 


Robert  E.  Fennell 


I .  INTRODUCTION 

Decentralized  control  problems  for  finite  dimensional  state  3pace  systems 
with  two  independent  controllers  are  considered.  Systems  of  the  form 


dh-j/dt  =*  <*i  i  hi  +  ai  2  h2  +  Si  u 
dh2/dt  -  ct2t  hi  +  022  ^2  +  02  u2 


(1) 


and 


dx/dt  «  F  x  +  G1  Ui  +  G2  U2 


(2) 


where  an,  ai2»  <321 »  a22»  01 »  02*  F»  G1 >  G2  denote  matrices  of  appropriate 
dimension  will  be  considered.  Independent  control  cannot  be  achieved  without 
some  restriction  upon  the  interaction  between  system  components.  The  objective 
of  this  paper  i3  to  characterize  geometric  and  algebraic  conditions  which  allow 
some  autonomy  in  the  choice  of  controls  for  systems  of  the  form  (1)  or  (2). 

In  Section  II,  a  general  decentralized  control  strategy  is  presented  for 
systems  of  the  form  (1).  The  approach  requires  that  each  component  control  law 
be  the  sum  of  a  feedback  term  and  an  open  loop  term,  that  an  additional 
constraint  be  added  to  the  component  control  requirements,  and  that  component 
interactions  be  suitably  limited.  Thi3  control  strategy  is  adapted  from 
previous  efforts,  Reneke  (1984),  in  which  variational  methods  were  used  to  show 
that  some  level  of  autonomous  component  control  is  possible  when  additional 
contraints  are  placed  upon  component  requirements  and  exchanges  of  related 
information  is  allowed.  The  approach  may  be  referred  to  as  multi-level  or 
hierachial,  see  Sandell  et  al.  (1978)  and  Findeisen  et  al.  (1980),  in  the  sense 
that  local  models  are  used  in  the  design  of  component  control  laws  and  a  higher 
level  coordination  problem  is  introduced. 
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The  decentralized  control  strategy  to  be  introduced  applies  when  the 
interaction  between  components  in  (1)  is  suitably  limited,  i.e.,  the  components 
are  stably  connected.  In  Section  II,  thi3  condition  is  characterized  in  terms 
of  geometric  properties  of  the  matrices  an,  a-jg.  <*21 »  and  “22* 

For  systems  of  the  form  (2)  controllability  subspaces,  see  Wonham  (1985 
(1),  or  strong  components,  see  Siljak  (1978)  or  Michel  et  al.  (1978),  may  be 
used  to  decompose  control  problems  into  problems  for  two  component  systems  of 
the  form  (1).  In  Section  III  such  a  decomposition  is  presented  and  the  stably 
connected  condition  is  characterized  in  this  case.  In  the  final  section, 
interconnected  hierachies  of  the  form  (1)  are  considered.  That  is  an  and  032 
are  assumed  to  be  block  lower  triangular  and  a  graph  theoretic  characterization 
of  the  stably  connected  condition  is  presented. 

c* 

II.  A  DECENTRALIZED  CONTROL  STRATEGY 

Let  (1)  be  written  in  integrated  form  as 

hi  •  fi  +■  Bi  hi  +  C£  h2  ♦  (1.1) 

hR  "  f 2  +  Ci  h2  +  B2  h2  +  V2  (1.2) 

where  Bi_h  -  a^Ch,  C^h  -  ajiCh,  »  Cu£  with  [Ch](t)  -  JqMtMt  and  (t ) -hi CO) 

for  {i ,J l«{l ,2} .  For  simplicity,  it  is  assumed  that  Bi»Ii  the  identity 
transformation  for  i-1,2.  Henceforth  whenever  indicies  i  or  j  appear  in  a 
statement  it  is  to  be  assumed  that  (i ,j  }-{l  ,2} .  Preliminary  calculations  show 
that  CC2h](t)  -  ]’o(t-T)h(T)dx  and,  using  Laplace  transforms  that 
C(I~C2)'"1h](t)  -  h(t)  +  Josinh(t— c)h(-c)dT.  Of  course  the  underlying  function 


apace  oust  be  restricted  so  that  this  inverse  operator  exists.  Similarly,  if 
[Aj.v](t)  -  /oexp(aii(t-T))v(t)dT  then  kL  -  (I-BO-1  and  -  I-Bj_ . 

The  control  problem  i3  to  choose  v1 ,  v 2  independently  to  steer  the 
components  from  a  given  position  1^(0)  -  hj_Q  to  a  desired  terminal  position 
hiCT)  -  hiT  for  i-1 ,2. 

Our  decentralized  control  strategy,  which  allows  seme  autonomy  in  the  choice 
of  component  controls,  requires  that  for  a  given  parameter  c^_  the  constraint 

[(I-C2r1AjCihi](T)  -  Ci  ( 3 . i ) 

be  added  to  the  ith  control  requirements,  that  component  interactions  be  limited 
so  that 

(I-C2)~1AjCi(I-C2)~1AiCj  -  0,  (4.1) 

c* 

and  that  the  control  law  for  the  ith  component  be  of  the  form 

▼l(t)  -  CAi“^c2(hl-Yl)*Ai“Hl«ii  (  .Ai)+ki2(  ,vi){](t)  (5.1) 

where  denotes  a  desired  trajectory  for  the  response  hj_ ,  the  functions 
kjj(t,X)  and  ki2(t,\;)  are  linear  in  the  parameters  respectivley ,  and  1^, 

vj_  satisfy 

hiT  -  C(I-C2)“’{Aifi>crC2Yi+ki1(  ,X)+ki2(  »v)](T) 

(6.1) 

Ci  -  CDi(I-C2)-,{Aifi-C2Yi*kil(  ,X)+ki2(  ,v) }](T) 
with  Dt  -  (I-C2)"!AjCi. 

THEOREM  1.  If  the  control  law  (5.i)  is  used  in  component  (l.i)  and  condition 
(4.J)  holds  then  the  response  hi  satisfies  hi(0)  -  hi0,  hjCT)  -  h^,  and  the 
additional  constraint  C(I-C2)"1AjCihi](T)  -  Ci  i3  satisfied. 
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Since  [Cjh](0)  -  0,  [B^hKO)  -  0,  and  CAj“^h](0)  -  h(Q)  for  all  functions 
h,  it  follows  that  h^(.Q)  -  f^O)  -  hj_Q.  Let  wj_(t)  -  CAi-,{kii(  .A^) 

+  k^2(  ,vt)}](t).  Substituting  ( 5 - i )  into  (l.i),  one  obtains  (1-3^ ) (I-C2)hi  - 
fi+cjhj"Ai'1c2Yi+wi*  Thua  hi  “  Cl-cZrMAif^AiCjhj-cZY^ki^  ,Ai)-ki2(  ,Vi)}. 
It  follows  that  hj_(T)-hix  and  [(I-C2)~1AjCihi](T)  -  c^  since  Xi.v^  satisfy 
equations  (6.i). 

In  this  decentralized  control  strategy  the  controller  for  the  it!l  component 
is  free  to  choose  the  desired  response  Yj.  and  the  functions  k^-j,  k^2  so  that 
condition  (3.i)  is  satisified  and  equations  (6.i)  can  be  solved  for  Ai,  v^.  The 
condition  (3.j)  is  the  only  information  about  the  jtfl  component  used  to 
determine  the  control  law  for  the  i^  component.  Here  component  controls  are 
coordinated  in  one  3tep,  i.e.f  for  given  Ci,  c2  component  control  objectives  are 
achieved  when  controls  are  determined  by  (5.1),  (5.2)  an'd  the  constraints  (3.1), 
(3.2)  are  satisfied.  Other  decentralized  control  strategies  typically  require 
off  line  iterative  calculations  between  controllers  for  coordination.  In  our 
strategy,  choice  of  appropriate  values  for  the  parameters  Cjt  c2  leads  to  a 
higher  level  coordination  problem. 

Optimization  techniques  cam  be  used  to  determine  specific  component  control 
laws.  For  example,  Reneke  (1984)  shows  that  a  control  law  of  form  (5.1)  is 
optimal  if  the  performance  index  J(u^,h£)  -  (1/2) J^[hi]2(T)+[Aj_hi]2(T)dT  is 
minimized  subject  to  the  constraints  h^  -  fi+Bihi+Cjhj+v^,  hj_(T)  - 
hiT»  CDj.h](T)  -  Cj_  given  that  [Djhj](T)  -  cj  and  D^Dj  -  0.  The  standard 
quadratic  C03t  functional  (1/2)/o[v^]2(T)-t.[hj_]2(T)dT  can  also  be  used  as  a  basis 
for  the  choice  of  component  control  laws,  see  Fennell  et  al.  (1985)  for  an 


example. 


Condition  (4.1),  (4.2),  i.e.,  -  D 2 D]  -  0,  represent  a  restriction  upon 


the  interaction  between  the  two  components.  Two  components  of  the  fora 
(1)  satisfying  such  conditions  are  referred  to  as  stably  connected  components. 
The  objective  of  this  paper  is  to  present  geometric  and  algebraic 
characterizations  of  the  stably  connected  condition. 

THEOREM  2.  The  components  in  (1)  are  stably  connected  if  and  only  if  C1A1C2  -  0 
and  C 2^2^!  ”  0* 

If  h  -  (I-C2)-1f  then  h  -  f  +  C2h  and  C^h  -  Cjf  +  Ci_C2h  -  Cjf  +  C^h.  By 
uniqueness  C^h  -  (I-C2)_1Cj_f ,  i.e.  Cj(I-C2)  -  (I -C2)Ci»  Therefore  D]_D2  -  D2D-J  - 
0  if  and  only  if  C]k]C2  -  0  and  C2A2 Cj  -  0. 

Thus  although  each  component  can  affect  the  other  the  stably  connected 
condition  implies  there  is  no  feed-through  effect.  Basic  properties  of  finite 
dimensional  systems  yield  the  following  geometric  characterization  of  the  stably 
connected  condition. 

THEOREM  3.  The  system  (1)  Is  stably  connected  if  and  only  If 
span[ai2»  a11a12»  a1 1  2»  •  •  •  1  CKer(a2i)  and 

span[a2i  .  <*22a21  »  a222°21 » . . .]  C  KerCa-j  2)  . 

Let  y(t)  -  [A^C2v] (t )  for  some  v,  0<t<T,  then  Invariance  properties  of 
controllability  subspaces  Imply  y(t)  belongs  to  span[ai2*  a11a12»  a112a12>***3 
for  0<t£T.  If  spanCai2»  2 »  °1 1  2°1  2>  •  * •  3  CfCer(a2i)  then  C -j y  -  0  and 

c1a1c2  *  Similarly  -  0.  For  the  converse,  let  w  be  in 

3panCai2*  ai1a12»  01 1 2ai  2.  •  • .]  and  choose  v  so  that  w  -  [AiC2v](T).  If 
c1a1c2  *  0  then  C^y  -  0  with  y  -  AiC2v.  It  follows  that  a2iy(t)  -  0  for  0£t£T 
and  hence  w  belongs  to  Ker(a2i). 


For  example  if 


P  0 

«11  "  “22  “ 

L°  1 

then  the  system  (1)  is  stably  connected. 

This  characterization  of  stably  connected  components  is  similar  to 
geometric  conditions  that  arise  in  disturbance  decoupling  problems,  3ee  Wonham 
(1985).  In  fact,  disturbance  decoupling  methods  can  be  used  to  modify  certain 
systems  of  the  form  (1)  through  local  feedback  so  that  the  resulting  two 
components  system  is  stably  connected. 

Let  A:Rn-*-Rn,  B:Rm-*-Rn  be  linear  transformations.  With  notation  as  in  Wonham 
(1985),  a  subspace  V  of  Rn  is  called  A-B  invariant  if  there  i3  a  linear 
transformation  FsRH-^R®  such  that  (A+BF)  V  C  I/.  For  a  subspace  K  of  Rn,  T(a,B,K) 
is  the  set  of  all  A-B  invariant  subspaces  which  are  also  subspaces  of  K.  The 
notation  V*  -  supT(A,B,fQ  denotes  the  element  of  T(A,B,K)  which  contains  all 
other  elements  of  T(A,B,K).  The  following  remark  i3  a  restatement  of  the 
solution  to  the  disturbance  decoupling  problem. 

Remark.  If  Im(ai2)  C  sup  (ai  i ,  0i  ,Ker (ct2i ) )  and  Im(a2i)C 
supT(a22>  B2»Ker(ai  2^  then  there  exist  matrices  Fi ,  F2  such  that -the  two 
component  system 

dh-j/dt  *  (ai  1  -*■  S i )h^  cf\2^Z  +  Slui 

dh2/dt  »  ^21^2  +  (a22+B2^2^2  +  B2U2 


and  ot-]  2  ”  a21 


ro  0 
1  0 . 


is  stably  connected. 

Use  of  high  gain,  local  feedback  loops  to  reject  interconnections  and  to 
aid  in  the  sythesis  of  decentralized  control  laws  has  been  reported  in  the  work 
of  Young  (1983) ,  (1985) . 


III.  DECOMPOSITION 


For  the  system  (2)  consider  the  problem  of  choosing  controls  ui ,  u2, 
independently ,  which  steer  the  system  from  a  given  initial  position  to  a  desired 
terminal  position.  In  this  section  a  method  to  decompose  the  control  problem 
for  (2)  into  a  problem  for  a  two  component  system  of  the  form  (1)is  presented. 
The  approach  uses  standard  methods  to  decompose  systems  of  the  form  (2)  into 
blocK  triangular  form.  Decomposition  of  (2)  into  block  triangular  form  using 
controllability  3ubspaces  or  strong  components  provides  a  geometric  view  of 
control  coordination  possibilities. 

Let  F  -  (Fjj),  G1  -  (Gljj)  and  G2  «  (G2jj)  denote  nxn,  nxm,  nxr  matrices 
with  respect  to  the  standard  basis  for  X  -  Rn  and  let  the  components  of  x,  u^  , 
u2  be  denoted  by  x  -  col  ( x -j , . . .  ,xn) ,  u^  -  col  (ui  -| , . . .  ,u-jm) ,  and  u2  - 

r* 

col(u21  , . . .  .u^) . 

Controllable  Canonical  Form.  A  coordinatization  of  tne  basic  controllable 
canonical  form,  introduced  by  Kalman,  Ho,  and  Narendra  (1961)  will  be  presented, 
see  also  Wonham  (1985). 

Assuming  (2)  is  controllable,  let  Xj_  denote  the  controllability  subspace 

determined  by  the  pair  (F,G^)  i-1,2.  Controllability  implies  X  -  X^+X2.  If 

X3  -  X-|nx2  then  either  X3  -  { 0 } ,  X3  -  Xi ,  X3  -  X:2,  or  X3  is  a  proper  nontrivial 

subspace  *Xj  and  X^.  In  any  case  there  exist  subspaces  Xi  and  X2  such  that 

Xt  -  Xt  X3,  X2  -  X2  X3  and  X  -  X2  X3. 

With  respect  to  the  standard  basis,  let  denote  a  matrix  whose  columns 

form  a  basis  for  X^ ,  i-1,2, 3  and  let  P  be  the  nxn  matrix  defined  by 

» 

P  -  ,w2,w3].  Since  Xj ,  X2,  and  X3  are  A  Invariant  the  change  of  coordinates 

x  -  Ph  leads  to  the  controllable  canonical  form 

dh/dt  -  oh  S^u^  ♦  02u2  (7) 


where 


"An  0  O' 

~31 1 

’  0 

a  - 

0  A22  0 

81  - 

0 

82  - 

S22 

_A31  A32  A33. 

-B1 3- 

-523-*- 

with  a  -  P_1FP,  Si  -  P~1G1  and  g2  m  P~]G2. 

Here  the  subsystems  determined  by  Ai i ,  0n  and  A22»  822  are  controllable 
whereas  the  system  determined  by  the  pair  A33,  (813,223)  need  not  be 
controllable,  see  Wonham  (1985),  as  the  example 


"0 

0 

0" 

T 

"0" 

a  - 

0 

Q 

0 

Si  - 

0 

,  82  - 

1 

_1 

1 

1  _ 

.0. 

_0_ 

illustrates. 

c* 

Numerical  computation  of  controllability  subspaces  using  recent  advances  in 
numerical  linear  algebra  is  considered  in  the  work  of  Klema  and  Laub  (1980),  Van 
Dooren  (1981),  Boley  (1981). 

Block  Triangular  Form.  Transformation  of  (2)  into  block  triangular  form 
can  be  achieved  by  graph  theoretic  methods,  see  Siljak  (1978),  Pichai,  -  et. 
al.  (1983)  or  Michel  et.  al.  (1978).  Let  D  -  {v,eI  be  the  directed  graph  with 
vertex  set  V  -  SUCiUC2  where  S  -  {xj,...,xn},  Ci  -  {u-j  1 , . .  .uim} ,  C2  - 
{u2i,...u2r}  and  edge  set  E  -  {(x£ ,Xj ) : aji*0 }  U  {  (ut  ,xj  )  :G1  j  i*Q }  U 
{ (u2i ,Xj ) :G2j i»0 } .  A  subgraph  D  -  (v  ,E  j  of  D  is  called  a  strong  component 
provided  for  each  pair  of  vertices  x^ ,  xj  in  V  there  is  a  directed  path  from  x^ 
to  Xj  with  each  edge  in  E  and  V  is  maximal  with  respect  to  this  property.  Let 
®i  •  {^i»Ei}.  denote  the  strong  components  of  D.  Clearly  Vj  - 

0,  Ej.n  Ej  -  0  for  i*j  and  V  Ej_ .  The  condensation  graph  CD  - 

{C7,CS}  has  m  vertices,  one  associated  with  each  strong  component,  say  vj_~Dj_, 
and  an  edge  from  vj_  to  vj  if  and  only  if  there  is  a  u  in  and  a  v  in  Vj  such 


■■■ - . 


that  (u,v)  i.3  in  E.  The  condensation  graph  determines  a  relabeling  of  indicies 
in  (2)  so  that  the  resulting  system  matrix  is  block  lower  triangular.  Hence, 
the  system  is  decomposed  into  a  "hi er achy  of  m  interconnected  components".  Let 
Si  »  {d^:  for  seme  i  there  i3  a  path  in  the  condensation  graph  frem  to  D^}. 
Similary  define  S2.  Let  S3  »  Si  S2  and  Si  -  S1-S3,  S 2  -  S2-S3.  Then  Si, 
S2<  S3  determine  a  relabeling  of  vertices  so  that  (2)  is  of  the  form  (7)  with 


1 

> 

0 

0 

_ _ j 

"an" 

"  0  " 

a  - 

0  A22  0 

Si  - 

0 

S2  * 

S22 

-A31  a32  a33_ 

-31  3- 

-023- 

Control  Problem  Decomposition .  Controls  Ui  and  U£  steer  the  solution  of  (2) 
from  x(0)  -  xq  to  x(T)  -  x-^  if  and  only  if  u^,  U2  steer  the  solution  of  (7)  from 
h(0)  =*  hg  to  h(T)  -  hr  where  hg  -  Pxg,  hT  -  Pxr  if  (7)  arises  from  the 
controllable  canonical  form  or  the  components  of  hg,  hj  are  obtained  from  those 
of  xg,  x-p  by  using  the  permutation  of  indices  which  determines  the  block  lower 
triangular  form.  To  further  decompose  the  problem  let  0  <  m0,mi  .mg  £  1  . 


h01 

hT1 

h10  " 

0 

_( 1"!Hg)hg3_ 

h1T  “ 

0 

_( 1-mg)hx3  _ 

'  0 

0 

h20  * 

h02 

h2T  * 

hT2 

_mghg3_ 

-®OhT3  - 

and  consider  the  following  two  control  problems. 
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CCNTRCL  PRC3LZM  I.  Find  which  steers  the  solution  or 


Here  (7.1)  and  (7.2)  are  of  the  form  (1).  Let  u1  and  u2  solve  CONTROL 
PROBLEMS  I,  II  respectively.  Notice  that  the  second  component  of  h-j  and  the 
first  component  of  h2  are  always  zero.  It  follows  that  h  -  hi+h2  satisfies  (7) 
and  h(0)  -  hg,  h(T)  -  hy.  That  is  ui  and  u2  steer  the  solution  of  (7)  from 
h(0)  -  h0  to  h(T)  -  hT . 

Clearly  if  mi=*0  or  m2=0  then  the  components  in  (7.1),  (7.2)  are  stably 
connected. 


THEOREM  4,  The  two  components  of  (7.1),  (7.2)  with  mi  and  m2  non-zero  are 
3tably  connected  if  and  only  if  A33A31  -  0,  A33A32  -  0,  and  A332  =•  0. 

With  notation  as  in  (7.1),  (7.2)  the  controllability  subspace  determined  by 
(cti  1,012)  is  spanned  by  the  columns  of  the  matrix 

0  0  0  0  0  ... 

0  0  0  0  0  ... 

A32  A33  A33A32  A332  A332A32  . 


A  vector  x  -  col (xj , X2,*2)  is  in  the  KerCa?])  if  and  only  if  A31X1+A33X3  -  °* 
Clearly  the  columns  of  the  above  matrix  lie  in  the  Ker (021)  if  and  only  if 
A33A32  -  0  and  A332  -  0.  Similarly,  the  controlability  subspace  determined  by 
(a22»a2l)  lie3  in  the  Ker(ai2)  if  and  only  if  A33A31  -  0  and  A332  -  0.  The 
result  follows  from  Theorem  2. 

With  notation  as  in  (1).  Theorem  H  implies  that  the  components  in  (7.1), 
(7.2)  are  stably  connected  if  and  only  if  <201  cci  2  •  0  and  cti2«21  *  0. 

IV .  INTERCONNECTED  HIERARCHIES . 

Graphic  theoretic  conditions  for  (1)  to  be  stably  connected  are  presented 
in  the  case  <21 1  and  022  have  a  hierarchial  structure.  Assume 

311  -  ( 3^  1 ,  i  j  )  i ,  j  =  1,...m  ^  “22  -  <«22»ij>i,  j-1,...,”l  with  “11*ij"°  and 

“22* ij”  0  for  i>J-  Let  ai2  *  (°12*ij)  ^d  321  -  (o2i»ij)  denote  mxn,  nxm 

matrices,  respectivley.  With  notation  as  in  Section  III  the  system  directed 

graph  D=(V,E)  may  be  described  as  follows  V  -  ViUV2  -  {xi  1 , . . .  ,xim }  U 

{x2i  ,  ...X21}  and  E  -  {(xu,xij):  au  U  {(xu.xy  ):  a2i  ,  j  i»0 }  U  { (x2i  ,xi  j  ) 

a12'ji’,°J  LJ  f(x2i»x2j):  °22'ji*^}’  Such  a  directed  graph  may  be  depicted  as 

follows: 


COMPONENT  I  COMPONENT  II 


THEOREM  5.  With  D-(V,E)  as  defined  above,  the  components  in  (1)  are  stably 
connected  if  and  only  if  there  exist  no  directed  path3  with  initial  and  terminal 
nodes  in  Vj_.  which  transverse  a  node  in  Vj  for  { i ,  J  }  -  ft, 2}. 

To  see  that  3panCa-|2»  a12a12>  •*,]  C  Ker(a2i)  we  argue  that 

a21a11*<ct12  ”  ®  f°r  k-0,  1 ,  •  •  •  ,m~  1 .  The  product  at21a12  "  0  since  there  are  no 
directed  paths  of  length  two  with  initial  and  terminal  nodes  in  V2  which 
transverse  a  node  in  V-|  .  The  product  ”  0  since  there  are  no  directed 

paths  of  length  three  with  initial  and  terminal  nodes  in  V2  which  transverse  two 
nodes  in  V-j .  Similarly  <121  a-|  ikai  2  *  0  for  k-Q, 1 , . . .  ,m-1 . 

Theorem  JT generalizes  to  the  case  where  -  ( V -j , E t )  and  D2  -  (V2,E2) 
represent  the  condensation  graphs  determined  by  an  and  022  respectively.  Here 
a-|  t ,  a22  are  bl°cl<  triangular,  and  a-|2»  a21  are  partitioned  accordingly. 

r* 

CONCLUDING  REMARK 

A  large  scale  system  with  multiple  components  is  said  to  be  3tably 
connected  provided  each  pair  of  components  satisfy  the  stably  connected 
condition.  The  decentralized  control  strategy  presented  in  this  paper  can  be 
generalized  to  a  decentralized  control  strategy  for  stably  connected  systems. 

If  a  system  matrix  is  block  triangular  then  the  blocks  determine  components 
3uch  that  the  system  is  stably  connected.  On  the  other  hand,  one  may  view  the 
components  as  basic  building  blocks  and  the  results  of  this  paper  indicate  how 
to  connect  the  components  together  to  form  more  complex  systems  while  at  the 
same  time  maintaining  some  autonomy  in  the  choice  of  component  control  laws 


laws . 
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